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Abstract 

Background: The Child Perception Questionnaire (CPQ 1M4 ) is a self-report instrument developed to measure oral- 
health-related quality of life (OHRQoL) in 11-14-year-olds. Earlier reports confirm that the 16-item short-form version 
performs adequately, but there is a need to determine the measure's validity and properties in larger and more 
diverse samples and settings. 

Aim: The objective of this study was to examine the performance of the 16-item short-form impact version of the 
CPQ 1M4 in different communities and cultures with diverse caries experience. 

Method: Cross-sectional epidemiological surveys of child oral health were conducted in two regions of New 
Zealand, one region in Brunei, and one in Brazil. Children were examined for dental caries (following WHO 
guidelines), and OHRQoL was measured using the 16-item short-form item-impact version of the CPQ n _ 14 , along 
with two global questions on OHRQoL. Children in the 20% with the greatest caries experience (DMF score) were 
categorised as the highest caries quintile. Construct validity was evaluated by comparing the mean scale scores 
across the categories of caries experience; correlational construct validity was assessed by comparing mean scores 
and children's global ratings of oral health and well-being. 

Results: There were substantial variations in caries experience among the different communities (from 1 .8 in Otago to 4.9 
in Northland) and in mean CPQ 1V14 scores (from 1 1.5 in Northland to 16.8 in Brunei). In all samples, those in the most 
severe caries experience quintile had higher mean CPQn_ 14 scores than those who were caries-free (P < 0.05). There were 
also greater CPQ scores in those with worse self-rated oral health, with the Otago sample presenting the most marked 
gradient across the response categories for self-rated oral health, from 'Excellent' to 'Fair/Poor' (9.6 to 19.7 respectively). 

Conclusion: The findings suggest that the 16-item short-form item impact version of the CPQ n _ 14 performs well 
across diverse cultures and levels of caries experience. Reasons for the differences in mean CPQ scores among the 
communities are unclear and may reflect subtle socio-cultural differences in subjective oral health among these 
populations, but elucidating these requires further exploration of the face and content validity of the measure in 
different populations. 

Keywords: Adolescents, caries experience, quality of life, validity, short-form CPQ n _ 14 



Introduction 

The CPQ n . 14 is a self-report questionnaire developed to 
measure oral health-related quality of life in children 
and adolescents [1]. The original CPQn_ 14 comprised 37 
items organised into four health domains. It is usually 
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administered with two additional items related to the 
child's global rating of his/her oral health; these serve as 
a validity check. Items for the CPQu_i 4 were selected 
using an item impact study which identified items of 
most importance to the patient population [1]. It was 
validated by using a clinical convenience sample [1] and 
a population sample [2], and has been cross-culturally 
adapted for use in a number of cultures and languages 
[3-7]. The questionnaire's length and the associated 
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respondent burden were thought to limit its routine use 
in dental epidemiology and health services research. The 
development of a short-form CPQn-14 was thought to 
broaden its application, by decreasing the likelihood of 
unit or item non-response and reducing respondent 
burden. Jokovic and co-workers developed four short- 
form versions of the CPQn_i 4 using two different 
approaches [8-10]. This resulted in two 8-item versions 
and two 16-item versions. 

The initial work using a clinical convenience sample 
showed that all four short-forms detected substantial 
variability in children's OHRQoL, with the 16-item ques- 
tionnaires being almost identical, and the 8-item ques- 
tionnaires only just differing [11]. Further validation of 
the short-form versions was provided in a study of a ran- 
dom population sample of New Zealand adolescents who 
had completed the full questionnaire. This work con- 
firmed that all short-form versions showed acceptable 
properties, but that the 16-item versions performed bet- 
ter [12]. These findings were then confirmed in a Brazi- 
lian convenience sample of 11- to 14-year-olds, who had 
been assigned to three groups (healthy, caries present, 
malocclusion present) after being examined. This study, 
being the first to administer only the short-form ques- 
tionnaire (rather than the longer version), provided evi- 
dence of the satisfactory properties (reliability and 
construct and discriminant validity) of the Brazilian ver- 
sion, although the 16-item version performed better than 
the 8-item one [13]. While the various studies findings 
on the short-form version support its validity, there has 
been substantial variation in mean CPQ scores [11,12]. 
These OHRQoL differences and the reason for them 
have not been reported on. There is a need to determine 
the shortened measure's validity and properties in larger 
and more diverse samples and settings before any recom- 
mendations on its future use can be made. 

The objective of this study was to further examine the 
performance of the 16-item short-form impact version 
of the CPQ U _ 14 in different communities and cultures 
with diverse caries experience, and to compare the sub- 
jective oral health of these different communities. 

Method 

Data from studies of children in New Zealand (North- 
land and Otago), Brunei and Brazil were used in this 
study. Each is briefly described below. All studies used 
the short-form 16-item impact version of the CPQn_i 4 
[12,13]. Two global questions on OHRQoL were also 
reported. First, participants were asked to rate the health 
of their teeth, lips, jaws and mouth; and second, they 
were asked how much their teeth, lips, jaw or mouth 
affects their life overall. Sociodemographic information 
was collected. All studies carried out dental caries 



examinations (following World Health Organization 
guidelines) using calibrated public-sector dentists [14]. 

Northland 

A cross-sectional epidemiological survey was conducted 
of all 12- and 13-year-old children attending schools in 
2008. Ethnicity was obtained from the children's parents 
and was classed as Maori or non-Maori. We also 
recorded the school "decile rating", the New Zealand 
Ministry of Education's targeted funding for educational 
achievement (TFEA) indicator for schools [15], which is 
an area-based socio-economic status (SES) measure 
which allocates scores ranging from 1 (lowest SES) to 
10 (highest SES) to schools. For intra-examiner reliabil- 
ity, the intraclass correlation coefficient for DMFS was 
1.00; for inter-examiner reliability, it was 0.98. Ethical 
approval for the study was obtained from the Northern 
Y Regional Ethics Committee. 

Otago 

A cross-sectional epidemiological survey was conducted 
of all 12- and 13-year-old children attending intermedi- 
ate schools in Dunedin in 2010. Ethnicity and socio-eco- 
nomic data were obtained from the parent. Ethnicity 
was classed as Maori or non-Maori. The area-based 
measure used was the NZDep2001 Index of Deprivation 
[16]. This combines nine variables measured in the 2001 
Census which reflect aspects of social and material 
deprivation; each Census meshblock has been allocated 
a deprivation score. In the current study, the area-based 
SES was then determined by geocoding each adoles- 
cent's street address and matching it (via meshblock 
number) to the NZDepOl data-base. For intra-examiner 
reliability, the intraclass correlation coefficient for 
DMFS was 0.96; for inter-examiner reliability, it was 
0.97. Ethical approval was obtained from the Lower 
South Ethics Committee. 

Brunei 

A cross-sectional epidemiological survey of Year-6 
schoolchildren (age 10 to 14) attending the nine govern- 
ment primary schools in Brunei Zone II (Brunei-Muara 
district) was conducted in 2010. A Malay version of the 
short-form CPQ was derived through a forward-back- 
ward translation process, then piloted and adapted. Eth- 
nicity information was collected from the parent/ 
caregiver. Information on the parent/caregiver's occupa- 
tion was recorded from the consent form. Household 
SES was then determined using the Malaysia Standard 
Classification of Occupations (2008). For intra-examiner 
reliability, the intraclass correlation coefficient for 
DMFS was 0.99; for inter-examiner reliability, it was 
0.99. Ethical approval was obtained from the Medical 
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and Health Research and Ethics Committee, Ministry of 
Health, Brunei. 

Brazil 

A cross-sectional study was conducted involving 11- to 
14-year-old schoolchildren in public and private schools 
from 13 municipalities in the Midwest Region of the 
Brazilian Southern State of Santa Catarina in 2009. 
Non-clinical data were collected through structured 
interviews, and included sociodemographic characteris- 
tics, including sex of the child and one measure of 
socio-economic status (whether the father was currently 
working). Ethnicity data were not collected. The repro- 
ducibility of clinical diagnosis was tested through dupli- 
cate examinations on 10% of the sample by each of the 
examiners; this showed Kappa values (both intra- and 
inter-examiner) greater than 0.8, calculated on a tooth- 
by-tooth basis. The project obtained approval by the 
Ethics Committee of the Universidade do Oeste de 
Santa Catarina, Brazil. 

Data were analysed using the Statistical Package for 
the Social Sciences (version 18). Missing responses for 
any item was allocated a score of zero at analysis stage. 
Children who presented in the 20% with the greatest 
caries experience (DMFS score) were categorised as the 
highest caries quintile (this ranged from DMFS = 4+ in 
Otago and Brunei to DMFS = 8+ in Northland). Follow- 
ing the computation of univariate descriptive statistics, 
differences among proportions were tested for statistical 
significance (P < 0.05) using chi-square tests; differences 
among means were tested for statistical significance (P < 
0.05). Construct validity was evaluated by comparing the 
mean scale scores across the categories of caries experi- 
ence using Mann-Whitney or Kruskal-Wallis tests (as 
appropriate). The alpha value was set at P < 0.05. Corre- 
lational construct validity was assessed by comparing 
mean scores and children's global ratings of oral health 
and well-being using Spearman's correlation coefficient. 

Results 

Data on the characteristics of the four samples are pre- 
sented in Table 1. Sample size ranged from 187 (North- 
land, New Zealand) to 457 (Brunei), with broadly similar 
age ranges (with the Brunei and Brazil data including 
10- and 11-year-olds). Males comprised approximately 
half of the participants in each sample. For ethnicity, the 
New Zealand children were classified as Maori or non- 
Maori, with the Northland sample having nearly three 
times more Maori than that from Otago. The Brazil 
children were all classified, as 'Brazilian' and most of the 
Brunei children were Malay. Mean DMFS score (Table 
1) ranged from 4.9 in Northland to 1.8 in Otago. The 
DMFT score of the Brazilian sample was similar to the 
DMFS score for Otago. 



Table 1 Characteristics of participants by study 





Northland 


Brunei 


Brazil 


Otago 


Sample size 


1 O J 


A 
■ i 




Z/ Z 


Age range 


12-13 


11-14 


11-14 


12-13 


No of 

Females (%) 


89 (48.2) 


217 (51.3) 


1 99 (49.3) 


1 27 (46.7) 


Mean DMFS 
(SD) 


4.9 (5.2) 


2.0 (3.8) 


1.8 (2.1 ) a 


1 .8 (3.2) 


Type of 
sample 


Convenience 


Convenience 


Convenience 


Convenience 


a Surface-level data were not available for the Brazil sample 



Construct validity 

The CPQn_i4 short-form of the questionnaire detected 
differences by caries experience (Figure 1) in each of the 
samples, with the mean scores for the highest-caries 
quintile group greater than those for the caries-free chil- 
dren. The smallest difference was observed in the 
Northland sample. Overall, the mean CPQn_i 4 score 
was highest for the Brunei sample followed by Otago 
with the lowest in Northland. The mean CPQn.14 and 
domain scores differed in all of the samples (Table 2) 
while the relative contribution of the domains ranged 
from 17 to 39%. The Brunei sample had the highest 
overall CPQn.14 score and presented with the greatest 
relative contribution from the social well-being domain. 
The Northland sample presented with the greatest 
DMFS score and had the greatest relative contribution 
to the CPQ from the oral symptoms domain. 



3 15 



s 10 



■Caries-free Others ■ Highest DMr quintile 




Northland 



Brazil 



Otago 



Figure 1 Mean CPQ n _ 14 and caries experience by sample 
(caries-free in solid black; others in light grey; highest quintile 
in dark grey) 
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Table 2 Mean ISF 16-item CPQn 14 scores and their relative contribution (SD) 

CPQn_ 14 (95% CI) Range of scores CPQ ln _ 14 domain scores Relative contribution to overall scale (%) a 



OS FL EW SW OS FL EW SW 

Northland 11.5(7.3)10.4 -12.6 1- 40 4.5(2.5) 2.2 (2.3) 2.6 (2.5) 2.4 (2.5) 39 19 22 20 

Brunei 16.8(8.7)16.0 -17.6 0 - 43 5.0(2.6) 3.8 (3.0) 4.3 (3.0) 3.7 (2.7) 30 22 26 22 

Brazil 12.4(9.2)11.5 -13.3 0 - 49 4.1(2.6) 2.8 (2.9) 3.4 (3.5) 2.1(2.5) 33 23 27 17 

Otago 14.6(8.6)13.6 -15.6 0 - 40 4.7(2.3) 3.4 (3.0) 3.7 (3.1) 2.8 (2.7) 32 23 25 19 



a OS = Oral Symptoms, FL = Functional Limitations, EW = Emotional Well-being, SW = Social Well-being 



All forms of the CPQn_i 4 showed greater scores in 
groups with worse self-reported oral health (Table 3). A 
consistent gradient was observed in the scores across 
the response categories from 'Not at all' to A lot/Very 
much' with the impact on quality of life for all except 
for the Brunei sample. A similar gradient was observed 
for the self-rated oral health responses 'Excellent' to 
'Fair/Poor' except for the Northland and Brunei sample. 
All samples demonstrated positive, statistically signifi- 
cant and similar correlations with the ratings of oral 
health and overall impact on quality of life, although it 
was lowest in the Brunei sample. 

Discussion 

Validation of the short-form measures of the CPQn_i 4 
at the population level is important, because clinical 



Table 3 Construct validity: performance of CPQ n 14 
versions against global questions 



Global Questions 




CPQ,,-, 4 


ISF16(SD) 






Northland 


Brunei 


Brazil 


Otago 


Self-rated oral health 










Excellent 


9.4 (4.2) a 


1 5.6 (7.6) a 


7.4 (6.0) b 


9.6 (6.7) b 


Very good 


9.1 (6.8) 


1 6.5 (9.0) 


8.3 (5.7) 


1 0.9 (7.0) 


Good 


1 1 .4 (6.8) 


1 5.6 (8.3) 


9.4 (7.2) 


14.1 (7.3) 


Fair/Poor 


1 6.3 (9.0) 


1 8.7 (9.0) 


15.7 


19.7 








(10.0) 


(10.1) 


Spearman's rho c 


0.28 


0.1 1 d 


0.38 


0.37 


Impact on quality of 










life 










Not at all 


8.9 (5.7) a 


1 3.89 (8.3) 

a 


7.6 (6.1) 


10.7 (5.6) b 


Very little 


1 2.4 (6.6) 


16.3 (9.1) 


1 3.8 (8.8) 


13.9 (7.1) 


Some 


14.6 (7.5) 


18.5(7.7) 


16.2 


18.2 (9.3) 








(10.3) 




A lot/Very much 


15.3 (0.9) 


1 7.8 (9.8) 


17.4 


24.8 








(10.2) 


(12.3) 


Spearman's rho c 


0.32 


0.19 


0.39 


0.37 



a p-value < 0.05 Kruskal-Wallis/Mann-Whitney 
b p-value < 0.01 Kruskal-Wallis/Mann-Whitney 
c correlation significant at 0.01 level 
d correlation significant at 0.05 level 



studies may give a misleading picture because of the 
biased nature of their samples [17]. This study of the 
performance of the short-form version of the CPQn_i 4 
among children from four different communities with 
differing caries experience has found that the short-form 
version of the CPQn_i 4 performs well in terms of valid- 
ity. However, the observed differences in mean scores 
across the samples need further exploration in order to 
fully understand what this phenomenon represents. 

Before discussing the findings, it is appropriate to con- 
sider the study's weaknesses and strengths. The non- 
representativeness of all of the samples is a weakness, 
because it means that the generalisability of the findings 
is limited. On the other hand, the relative uniformity of 
findings in convenience samples from a number of differ- 
ent communities within New Zealand and internationally 
is a strength, in that it suggests that the short-form ver- 
sion has validity in different settings and populations. 
Among the study's other strengths was that the short- 
form version was administered to adolescents prior to 
being clinically examined in all the samples as well as the 
comprehensiveness of the data collection (with caries 
data collected at surface level rather than tooth level, for 
all but one sample) with examinations conducted under 
acceptable conditions by calibrated dentists in public 
health settings rather than in other, more ad hoc settings. 

The construct validity of the short-form version is 
supported by its ability to detect differences in quality of 
life, evident in the highest scores being seen in the chil- 
dren with the greatest caries burden. A clear difference 
did exist, with greater mean CPQn_i 4 scores in children 
presenting with the greatest caries experience relative to 
those who were caries free, and this held irrespective of 
the community. Concerning dental caries experience, 
there were distinct CPQ differences (in both the overall 
and the domain scores) between those who were in the 
highest quartile for DMFS and the remainder. These 
findings are not counter-intuitive: other factors being 
equal, children in the most severe disease quartile are 
likely (for example) to have experienced more oral pain, 
had difficulties in chewing, to have worried or been 
upset about their mouths, or to have missed school due 
to their cumulative disease experience [1]. 
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Variations among populations were apparent, with 
Brunei children reporting higher scores (indicating a 
greater impact on their OHRQoL). Even within the 
same country (New Zealand), variations existed. These 
appear not to be related to overall caries experience. 
Comparing samples, there appears to be no clear asso- 
ciation between mean CPQ score and caries experience, 
as the sample with the greatest caries burden did not 
have the highest mean CPQ score. The Northland chil- 
dren had more than twice the caries burden of those 
from Brunei, Brazil and Otago, but this was not 
reflected in their overall mean CPQ score. However, 
they did have the greatest relative contribution of the 
oral symptoms domain to that score. 

The earlier reported New Zealand study using the 37- 
item questionnaire to evaluate the short-form version 
had a lower mean score than either of the two New 
Zealand samples in this study. This could be due to the 
possibility that the children may have responded differ- 
ently when answering the longer questionnaire. How- 
ever, an Australian study found no significance 
differences in scores when the short-form 12-item 
health survey version was embedded in the longer-form 
36-item version as opposed to administering it sepa- 
rately to an equivalent representative sample [18]. The 
current study shows that there were different overall 
scores (even with both samples having the short-form 
self- administered) in the two New Zealand samples, and 
it is more than likely the difference in scores may reflect 
differences in the populations of adolescents in the New 
Zealand regions. This was not reflected in the current 
Brazil sample, as its mean CPQ score was very similar 
to the earlier reported Brazil study with the mean scores 
(12.4 and 12.9 respectively) differing by a small amount 
[13]. This similarity may reflect heterogeneity in the 
Brazilian population which does not occur in New Zeal- 
and, or it could be an artefact, and if another Brazilian 
community was sampled, a different mean CPQ score 
could occur, as is the case in New Zealand. 

This variation within and between countries makes 
cross-cultural comparisons using mean CPQ scores dif- 
ficult to interpret. This has already been found with the 
14-item Oral Health Impact Profile (OHIP) when com- 
paring oral disorders in the United Kingdom and Aus- 
tralia, with dentate Australians reporting a higher 
number of impacts than dentate United Kingdom adults. 
These differences may have reflected subtle socio-cul- 
tural differences in subjective oral health among these 
populations [19] and could similarly account for the dif- 
ferences in our samples under study. They also surmised 
that these subtle differences can tell us quite a lot about 
the social and psycho-social influences on oral health- 
related quality of life between populations and among 
sub-groups within populations. In an earlier study of 



older people in South Australia, Ontario and North Car- 
olina, smaller differences were observed between coun- 
tries than between different racial groups within 
countries [8]. This sort of effect may account for the dif- 
ferences in the Northland and Otago communities, with 
over two-thirds of the Northland sample (but fewer 
than the one-fifth of the Otago sample) being Maori. 

The case for construct validity is further supported by 
the assessment of the short-form of the CPQn_i 4 
against the global questions. All of the samples demon- 
strated positive and significant correlations with both 
global questions, as observed in the recent studies 
reporting on short-form versions (13,15) and all samples 
had a higher score in those with poorer oral health. 
Overall, mean scale scores were greater for those report- 
ing 'Fair/Poor' self-rated oral health than for those 
reporting A lot/Very much' impact on their quality of 
life. In developing the short-form versions, Jokovic and 
co-workers predicted that, in evaluating construct valid- 
ity, the correlation coefficient would be higher for the 
rating of well-being than for the rating of oral health, 
because the former is a measure of health-related quality 
of life and the latter a measure of health (11). This had 
been shown in the longer questionnaire and was borne 
out in the Toronto clinical convenience sample data 

(13) and the earlier New Zealand population sample 

(14) , although it was not reported with the two item- 
impact short-form versions administered in Brazil (15). 
This meant that the smaller number of items in the 
short-form version might compromise its construct 
validity. In the current study, higher correlations were 
reported between the CPQ and well-being than for self- 
rated oral health in nearly all of the samples (Otago had 
the same score). This reinforces the fact that the items 
in the short-form also address issues and concerns that 
go beyond oral health and are of sufficient magnitude to 
have some effect on life as a whole [17]. This confirms 
that the smaller number of items in the short-form ver- 
sion does not compromise its construct validity. 

The current study confirms that the 16-item short- 
form impact version of the CPQn_i 4 performs well 
across diverse cultures and levels of caries experience. 
Differences in mean CPQ scores between the commu- 
nities may reflect subtle socio-cultural differences in 
subjective oral health between these populations but 
elucidating these requires further exploration of the face 
and content validity of the measure in different popula- 
tions. Further population-based research is required in 
order to further explore the cross-cultural utility of the 
CPQu_ 14 and the underlying importance of the measure. 
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